Search AI Products and News

Google Research recently announced the innovative 'Titans' series model architecture, achieving a groundbreaking 2 million token context length through bionic design, with plans to open-source related technologies in the future. The core innovation of this architecture is the introduction of a Deep Neural Long-Term Memory Module, inspired by the human memory system. Titans cleverly combines the rapid response capability of short-term memory with the persistence characteristics of long-term memory, while utilizing an attention mechanism to handle immediate context, forming an efficient information processing system.

IBM has officially launched its next-generation open-source large language model, Granite3.1, aiming to secure a leading position in the enterprise AI sector. This series of models features an extended context length of 128K, embedding models, built-in hallucination detection capabilities, and significant performance improvements. IBM claims that the Granite8B Instruct model outperforms its open-source competitors of similar scale, including Meta's Llama3.1, Qwen2.5, and Google's Gemma2.

🚀 Large model companies are competing to upgrade, making the focus on handling 'long text' a new trend. 📈 The article emphasizes that the challenge of context length is actually related to the Transformer structure. 📚 Long text technology will bring deeper applications to the fields of finance, justice, and scientific research.